Universal interpretation of efficacy parameter in perturbed nonequilibrium systems 
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The fluctuation theorems have remained one of the cornerstones in the study of systems that are 
driven far out of equilibrium, and they provide strong constraints on the fraction of trajectories that 
behave atypically in light of the second law. They have mainly been derived for a predetermined 
external drive applied to the system. However, to improve the efficiency of a process, one needs to 
incorporate protocols that are modified by receiving feedbacks about the recent state of the system, 
during its evolution. In such a case, the forms of the conventional fluctuation theorems get modified, 
the correction term involving terms that depend on the way the reverse/conjugate process is defined, 
namely, the rules of using feedback in order to generate the exact time-reversed/conjugate protocols. 
We show in this paper that this can be done in a large number of ways, and in each case we would 
get a different expression for the correction terms. This would in turn lead to several lower bounds 
on the mean work that must be performed on the system, or on the entropy changes. Here we 
analyze a form of the extended fluctuation theorems that involves the efficacy parameter, and find 
that this form gives rise to a lower bound for the mean work that retains a consistent physical 
meaning regardless of the design of feedback along the conjugate process, as opposed to the case of 
the previously mentioned form of the modified fluctuation theorems. 

PACS numbers: 05.40.-a, 05.70.Ln, 05.20.-y 
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I. INTRODUCTION 

The theory of classical thermodynamics has been 
well supported by the methods of equilibrium statistical 
physics, which in turn is based on the Boltzmann prob- 
ability distribution for the states of a system in phase 
space. For systems that are slightly away from equilib- 
rium (where the perturbation to the system can be as- 
sumed to be linearly coupled to the applied weak force 
field), the linear response theory characterizes the re- 
sponse of the system in terms of equilibrium correlation 
functions. However, there are only very few exact results 
that remain valid even when the system is driven arbi- 
trarily out of equilibrium. The fluctuation theorems have 
been one of them. First introduced for thermostatted sys- 
tems following dissipative but deterministic dynamics by 
Evans and SearlesfJ, Hf , it has produced several closely 
related equalities [3h|8[ , some theorems holding in general 
for all systems while the others being satisfied for special 
cases (for example, in the limit of a large observation 
time). In a nutshell, these theorems have the following 
general form: 



P(Xt) 
P T {X?) 



= e x \ 



(1) 



where X t is some observable that is to be measured 
and is in general a path function, P(X t ) is the proba- 
bility density of this observable along a process (usually 
parametrized by an externally controlled time-dependent 
protocol X(t)) and P T is the probability density whose 



functional form is related to P through a conjugate trans- 
formation which is not necessarily time-reversal. Its ar- 
gument Xj is the value assumed by the observable along 
the transformed trajectory in phase space. Some observ- 
ables that have been shown to follow the fluctuation the- 
orems are entropy, work and heat [3l— Tloi| . It is easy to 
see that the theorems are closely related to the second 
law, in the sense that the averaged observable (Xt) al- 
ways abides by the inequalities dictated by the second 
law. For instance, the total entropy of the system plus 
environment can be shown to give rise to the inequality 
01 



(Astot) > 0. 



(2) 



What this inequality says is that, even though some indi- 
vidual realizations of the experiment may observe a de- 
crease in the total entropy, its average value must never 
decrease with time. 

An issue that has recently attracted much interest is 
the use of feedback-controlled protocol to enhance the ef- 
ficiency of such a process [lll - [2fj | . Instead of using a pre- 
determined protocol, we can perform intermediate mea- 
surements on some observable and modify our protocol 
accordingly. We are in general not interested in the mea- 
suring device involved in the experiment (which definitely 
belongs to the "universe" in which second law must be 
obeyed). It is obvious that the form of the second law, 
now dealing with only a part of the universe under con- 
sideration, needs to be modified. As expected, the correc- 
tion term involves the properties of the ignored subpart, 
in the form of the mutual information gained through 
measurements and gives rise to the following inequality: 
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(3) 
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Here, the mutual information is defined as IllMl 



In 



p(mi\x 1 )p{m 2 \x 2 ) ■ ■■P{m N \x N ) 
P{m 1 ,m 2 , ■ ■ ■ ,mjv) 



(4) 
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where the presence of measurement errors is assumed 
the arguments of the conditional probability p(m,i\xi), m, 
is the outcome when a measurement is performed, while 
Xi is the actual value of the observable. The averaging 
has been done over all possible phase space trajectories as 
well as over all possible protocol functions, which results 
due to the different feedback rules corresponding to dif- 
ferent outcomes. Since (I) is a relative entropy and con- 



sequently always non- negative [21|, the above inequality 



provides us with the privilege of extracting work from or 
obtaining a decrease in entropy of the system, provided 
we can formulate a nice feedback algorithm. Note that 
eq. ([3]) only says that the lower bound for the dissipated 
work (or entropy) can be decreased by an amount pro- 
portional to the average mutual information. However, 
it does not provide any clue to what a good feedback al- 
gorithm should be. In this sense, it is reasonable to look 
for a quantity that actually provides a quantitative mea- 
sure of how efficient an employed feedback procedure is. 
This is the so-called efficacy parameter [13| defined be- 
low. In this paper, we clarify the physical meaning and 
some of theproperties of this parameter. The Jarzynski 
equality 0, [j] has two different generalized forms in the 
presence of feedback. The more commonly used form of 
the extended Jarzynski Equality (EJE) is [Tll - [l6| 



-l3W d [X]-I[X,M]\ 



1. 



(5) 



Wd is the dissipated work defined through Wd = W — 
AF, where AF is the difference between free energies at 
the end and at the beginning of a particular protocol. 
Here, the reverse trajectories are generated by simply 
reversing the sequence of one of the forward protocols 
and we have used upper case letters to denote the full 
path of successive phase points or measured outcomes: 
X = (xq, Xi, ■ ■ • ,x T ), M = (mi, m2, • • • ,tun). The time 
has been discretized as (to,ti,ts, ■ ■ ■ , ijv, tjv+i)- We will 
set <o = and t/v+i = t. As we will show in this paper, 
I[X, M] will in general be replaced by a different physical 
quantity <j>[X, M], if we choose to use feedback along the 
reverse process as well, as will be detailed below. 

Other than eq. ([5|), there is yet another form of the 
extended Jarz yns ki Equality that has been introduced in 
the literature [H,ll3|: 



-pw d [x] 



)=!■ 



(6) 



The efficacy parameter 7 is a functional of the feedback 
control used along the forward process, and that deter- 
mines the extent to which the feedback is efficient (i.e., 
more work can be extracted from the system). If 7 = 1, 
then we would have the Jarzynski equality in absence 
of feedback. The efficacy parameter has been measured 
experimentally [22j and equations (JSJ and (JB]) have been 



verified. Using the Jensen's inequality, we have the dis- 
sipated work bounded from below through the relation 



(W d [X}} > - In 7 



(7) 



Although this inequality looks similar to the one stated 
before, it may seem to be a trivial statement because it 
is a simple consequence of the definition of 7. However, 
the fact that this definition lends a very clear physical 
meaning to the efficacy parameter and that this mean- 
ing can be exploited to experimentally measure 7 (with- 
out using the definition eq. ([6])) underlines the impor- 
tance of the above bound. We explicitly show that 7 
retains the simple meaning when we extend eq. (JBJ) to 
driven systems that make excursions among nonequilib- 
rium steady states under arbitrary feedback-controlled 
protocols, whereas the physical meaning of <f)[X,M] de- 
pends on the design of feedback along the reverse process. 



II. EXTENDED JARZYNSKI EQUALITY 
A. Blind time-reversal of protocol 

As shown in [HHIfl, 

in presence of information gain 
and feedback applied only along the forward trajectory, 
the Jarzynski Equality gets modified to eq. ([5]). This 
relation is easily derived from the detailed fluctuation 
theorem, in the case when the reverse protocol is the 
blind time-reversal of the corresponding protocol along 
the forward process. Then the ratio of the forward and 
reverse trajectories become fl4l - [Tt| 

P[X,M] = P\X] x p{m l \x 1 )p{m 2 \x 2 )---P{m N \x N ) 
P[X-M] P[X] P(mi,m 2 ,--- ,m N ) 

_ p 0Wd[X}+I[XM\ 



(8) 



In the above equation, X is the time-reversed trajectory 
(x T , xn, ■ • • , xq), and P[X] is the probability density for 
this time-reversed trajectory (for simplicity of notation, 
we would always use the forward time t even during the 
reverse process, in place of using the actual time t = r — t 
elapsed during the reverse process). If the state is de- 
noted only by the position variable, then we have Xi = Xj. 
P[X; M] is the probability path functional for the actual 
reverse process being carried out. This is different from 
P[X, M] which gives the probability of obtaining the re- 
verse phase space trajectory along with the reversed mea- 
sured outcomes, provided measurements are performed 
at the same time instants as in the forward process. The 
expression for the latter quantity has no explicit refer- 
ence to the actual feedback procedure followed to gen- 
erate the reverse process (i.e., its physical meaning does 
not change due to change in feedback procedure for re- 
verse process). A simple cross- multiplication followed by 
integration over X and M will give rise to the modified 
Jarzynski Equality, eq. ([5]). 
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B. Using feedback to generate reverse process 

The reverse process can also be defined by designing a 
suitable feedback procedure to generate the time-reversed 
protocol, which does not violate causality [23] . The feed- 
back procedure is as follows: we first measure system ob- 
servable at time t = t, and if the measurement outcome 
is equal to the forward outcome at time t = tjv, then we 
drive the system using the reverse protocol A(m tjv ) (note 
that the time instants for measurement along the back- 
ward process are not the same as the forward ones, but 
are shifted). Continuing with this process, i.e., changing 
the protocol according to measurement outcome m(tk-i) 
at time t = tk, the reverse protocol is exactly reproduced 
without ever violating causality. This the new relation 



P[X,M] 
P[X-M] 



a /SW d [X]+As p [X,M] 



(9) 



where 



As p [X,M] = In 



p(m \x )p(mi\xi) ■ • -p(mjv|^jv) 



p(m N \xN +i)p(m N _i|xjv) ■ • -p(mo\xi) 

. (10) 

Here, As p represents a disorder parameter, but is not 
the mutual information as defined in [l2j]. Of course, 
equations (JSJ and © contain different information as well 
as provide different bounds for the average total entropy 
change for the system. 



C. The most general case 




FIG. 1: The figure shows the representative plot of the phase 
pace trajectory in a simple case for the most general form of 
feedback that can be considered during the reverse process 
(the lower curve) corresponding to the forward process (the 
upper curve). First, from t = r to t = t n , we have the 
feedback-controlled reverse protocol, while from t = t„ to 
t — tk we have used the blindly time-reversed protocol. In the 
final part, up to t — 0, we revert to the feedback-controlled 
protocol. 

The general form of the probability density for a for- 
ward trajectory in presence of feedback is given by [l6j 

P[X,M] =p(m \xo)P mo [x ->■ xx]p(mi\xi)P mi [xi -> x 2 ] 
■ ■ -p{m N \x N )P mN [x N ->• x T }. (11) 



The general protocol to generate the reverse process 
would be to use both the protocols III Al and III Bl at ran- 
dom during the reverse process. Let us take one sim- 
ple case when, along the reverse process, up to time 
t = t — t n , we use the feedback-controlled protocol, then 
from time t = t n to t = tk, we use the blindly applied re- 
verse protocol, and finally from t — t k to t = Q, we once 
again use the feedback-controlled reverse protocol (see 
figure [1]). Here, k and n can be any two integers chosen 
at random from the set {1, 2, • • • , N}. In this case, the 
reverse process becomes, 

P[X;M] = p(x T )p(m N \x T )P mN [x T 

p(m N _ 1 \x N )P mN _ 1 [x N -> x N -i] 
p(m n \x n+ i)P mn [x n+ i -> x n ] 
p(m n -i, ■ ■ ■ ,m k )P[x n -> x k ]p(m k ^i\x k ) 
P[x k ->■ Xfe_i] • • ■ p{m,Q\xi)P[xi -> x }. (12) 

Therefore, we arrive at 

P[X, M] _ P[X] p(m k \x k ) ■ ■ ■ p{m n -i\x n -i) 
P[X;M] ~P[X] p(m k ,--- ,m„_i) 
p(m \x Q ) ■ ■ -p{mk-i\xk-i) 



p(m \xi) 
p(m n \x n \ 



■p{mk-i\xk) 
■p{m N \x N ) 



p(m n \x n+ i) ■ ■ •p(mjvl^T) 
= exp [pW d + I 1 + Asl + As 2 p ] , (13) 



where 



Asl 



In 



In 



p(m k \x k ) ■ ■ -p(m n _i|x n _i) 



p(m k , 


• • • , m„_i) 


p(m \x ) ■ ■ 


■p{mk-i\xk-i) _ 


p(m \xi) ■ 


• -p(mk-i\xk) 


p(m n \x n ) ■ 


■ -pim^XN) 



(14) 
(15) 
(16) 



^ Sp ln p(m„|x„ + i) • • •p(m A r|i r; 

We are thus led to a different extended detailed fluctua- 
tion theorem where disorder parameters As^,, I 1 and As 2 
are different as they contain different information about 
the feedback process. Moreover, these are not unique and 
may depend on different reverse protocols not considered 
here. Thus, it is clear that the <f>[X, M] in eq. © does not 
have a unique interpretation and clearly depends on the 
manner of feedback along the backward process. From 
eq. (IT31 . one can obtain the related integral fluctuation 
theorem, namely 



(exp[-f3W d -I 1 - Asl - As p]> = 1 



(17) 



All the three results derived above, eqs. (JU), © and 
(1131) . can be written in compact form as 



P[X, M] 



o 0W d +<f>[X,M] 



(18) 



PLY; M] 

where <j>\X, M] is a functional of the phase space space 
trajectory as well as of the measurement trajectory (i.e., 
sequence of measured outcomes). 

We next turn our attention to the efficacy parameter. 
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III. EFFICACY PARAMETER IN PRESENCE 
OF GENERAL FEEDBACK 



by 



In absence of feedback, the Jarzynski equality is given 



( e -W.[*l) = i. 



(19) 



In presence of feedback, the right hand side of the above 
relation will in general not be unity. The efficacy param- 
eter for the feedback in this case (when system is initially 
at thermal equilibrium with the medium) is defined as 
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_ ,-f)W d [X} 



(20) 



It can be readily seen that lesser the amount of dissipated 
work, more is the magnitude of the efficacy parameter, 
as is desirable for a quantity that decides the efficiency of 
feedback. Now we use the most general case for obtaining 
the reverse trajectories, namely the case III Cl 
Therefore, we get 



7 = J V[X,M]P[X,M]e 
= f V[X, M]P[X; M]e As p +ll+As l 



-W d [X,M] 



V[X,M)P[X}p{m Q \x )p{m 1 \x 1 ) 

■ ■ ■p(m N \x N ) 
= / V[X,M}P[X]p(mo\x )---p(m N \x N ) 



= J V[X , M]P[X , M] = J V[M)P[M), (21) 

where we have used the detailed fluctuation theorem 
(fTgj). and the definitions $T5§, dHJ) and JTBJ. The 
time-reversibility of measurements has been assumed: 
p(nii\xi) = p{fhi\xi) [l2l |. Once again we may recall that 
the two quantities P[X; M] and P[X, M], both of which 
appear in the above derivation, are different. In more 
general cases, the steps 2 and 3 can be written as 

P[X; M}e' p[XM] = P[X- M] exp As l p + ^ P 



= P[X]p(mi\xi) ■ ■ -p(m N \x N ) 
= P{X]p(rhi\xi) ■ ■ ■p{fh N \x N ) 
= P[X,M]. 



(22) 



Here, the summations and run over all the time 
intervals in which the reverse protocols have been exe- 
cuted using feedback and by blind time-reversal, respec- 
tively. We find that although the form of P[X; M] con- 
tains detailed information about the actual feedback pro- 
cedure used along the backward process, when it is mul- 
tiplied by the factor e^ x,M \ we obtain P[X,M] whose 
form does not contain any such information. This is the 



reason behind the fact that the efficacy parameter re- 
tains the same physical meaning in each case, namely, it 
is the total probability to observe the time-reversed out- 
comes for the measurements performed along the reverse 
process 

This derivation of 7 for the most general case is our 
central result. It simply shows that it retains the same 
meaning as for the specific cases considered in the earlier 
literature [ljlljj. 



IV. THE THREE DETAILED FLUCTUATION 
THEOREMS 

We will be generalizing our treatment to the other 
detailed fluctuation theorems, which involve the non- 
adiabatic entropy production (change in entropy due 
to shift between two different steady states) and adi- 
abatic entropy production (change in entropy caused 
due to maintenance of a given steady state). The to- 
tal entropy change by definition is the sum of entropy 
changes in the system (As) and in the medium (As m ): 
As tot = As + As m . Recently it has been observed that 
while generalizing the second law for systems making 
transitions between steady states, the total entropy pro- 
duction can also be split into two distinct parts such that 
each part, interestingly, follows a detailed fluctuation the- 
orem HIS: 



Astot = As, 



As a . 



(23) 



The averages of all these three quantities are always non- 
negative, thereby providing a new twist to the second law. 
As a is related to the housekeeping heat Qhk, while As na 
is the sum of the entropy change of the s yste m and the 
entropy produced due to excess heat Q ex |24T-[27||. 

In the case of adiabatic and non-adiabatic entropy pro- 
ductions, the concept of dual dynamics is very helpful. 
Under the dual dynamics, if the system is allowed to 
reach the corresponding steady state, then the steady- 
state distribution pss retains the same form, but the 
probability current reverses its sign [27], HH]. Hatano 
and Sasa had shown that the physical meaning of the 
nonadiabatic entropy becomes clear in the dual dynam- 
ics formalism [2^|. These detailed fluctuation theorems 
are taken up in the following discussion. 



A. Total entropy 

When the initial state of the system is not at thermal 
equilibrium with the bath, then in absence of feedback, 
the following ratio is obtained between the forward and 
the reverse trajectories @, H, EH : 



P[X] 
P[X] 



As tot [X] 



(24) 
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from which the following integral fluctuation theorem can 
be obtained: 



(e 



-As tot [X] 



) = 1- 



(25) 



In presence of feedback, the right hand side will in general 
be different from unity. For this general case, instead of 
eq. (|18p. we would get the following ratio between the 
forward and reverse paths: 



P[X, M] 
P[X;M] 



(26) 



We now consider the case with general reverse protocol. 
We define the efficacy parameter as 

Itot = (e~ As ^) (27) 

Proceeding in exactly the same way as before, we find 

7tot = J V[X,M]P[X,M}e- As ^ x >W 
= [ V[X,M)P[X;M]e^ [x ' M] 

V[M]P[M]. (28) 



Thus, jtot retains the same physical meaning as 7 for 
the Jarzynski equality, although here we do not have the 
constraint of sampling the initial state of the system from 
the Boltzmann distribution. 



B. Nonadiabatic entropy 



in section 2. The efficacy parameter in this case is given 
by 



Ina = (e 



_ / -As„ a [XU _ 



} = J V[X,M]P[X,M]e 



As na [X,M] 



T>[X,M]pi[X;M] 



>[X,M] 



= / 'D[X,M}pt[X}p(m 1 \x 1 )---p(m N \x N ) 

= j V[X,M]P^[X,M} = J V[M]P^[M]. (31) 

In the third step, we have used the algebra that has al- 
ready been shown in the case of the most general pro- 
tocol (section [TTTJ) for extended Jarzynski equality, which 
results in 

Pt [X; M]e^' M l = [X] exp ^ A S ; + ^ P 

= P 1 ! [X]p(mi\xi) ■ ■■p(m N \x N ) 

= P^[X]pt{m 1 \i l )---p\m N \x N ) 

= P>[X,M}. (32) 

We have assumed that the measurement errors do not 
change on changing the dynamics, which is quite rea- 
sonable assumption. Thus, j na is the net probability 
for obtaining the time-reversed outcomes along the time- 
reversed dual dynamics (i.e., the process in which the 
protocol corresponding to the dual dynamics is time- 
reversed) . 



For transitions between nonequilibrium steady states, 
we have the following detailed fluctuation theorem in ab- 
sence of feedback M M EH: 



P[X] 
Pt[X] 



(29) 



The superscript \ implies dual dynamics, which implies 
that keeping the functional form of the protocol same, 
we are switching to a dynamics where the steady state 
current simply changes direction as compared to the orig- 
inal dynamics. The tilde symbol over P implies that the 
protocol for the forward process has been time-reversed 
after the system has been allowed to follow the dual dy- 
namics. In other words, P+ [X] is the probability density 
for a trajectory along the process generated, in presence 
of dual dynamics, by the time-reversed protocol. Simi- 
lar to the above cases, in presence of feedback, we have 

MM 



P[X, M] 
Pt[X;M] 



_ p As na [X]+<l>[X,U] 



(30) 



where the form of <fi[X, M] depends on the way in which 
feedback is applied along the reverse trajectory, as given 



C. Adiabatic entropy 

The DFT for adiabatic entropy production is given by 

MM 



P[X] 
Pt[X] 



^As a [X] 



(33) 



[X] is the probability density for the path followed by 
the system in phase space, when the system is evolving 
under the dual dynamics. In presence of feedback, we 
then have, 



P[X, M] 
pT[X~M] 



_ f> As a [X]+^[X,M] 



(34) 



Since there is no time-reversal involved, the denominator 
can only consist of the following options: 

(1) The same feedback procedure is used to generate 
the forward process in the dual dynamics as well, in which 
case we have 4>[X, M] = (since the error probabilities 
in the numerator cancel with those in the denominator). 
Once again, measurement errors are assumed to be inde- 
pendent of the dynamics followed by the system. 
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(2) One of the forward protocols in the original dynam- 
ics is recorded, and this protocol is blindly executed in 
presence of the dual dynamics, in which case we simply 
have c/>[X,M] =I[X,M], 

(3) We use the above two procedures at random while 
generating the forward trajectories in presence of dual 
dynamics, which is the most general case. In this case, 
however, <j)[X, M] = y~]j P , i.e., the summation over As l p 
will be absent, because the latter quantity never appears 
in this case. 

The efficacy parameter is 



7a = (e 



~As a [X] 



}, 



(35) 



which leads to 



la 



V[X, M]P[X 1 M]e 



-As a [X,M] 



= J V[X,M]P Ji [X;M]e^ 11 = J V[M]P ] [M]. 

(36) 

Therefore, j a is the total probability for observing the 
same outcomes as the initial process with the same pro- 
tocol, if the system follows the dual dynamics. 

We thus find that the physical meaning of effi- 
cacy parameter can be very generally stated as fol- 
lows: it is the total probability to observe the measured 
outcomes conjugate to those along the forward proto- 
col, for the intermediate measurements along the pro- 
cess with the corresponding conjugate dynamics. Since 
the efficacy parameters are experimentally measurable, 
they would provide more meaningful bounds for the 
(W d ), (As a ), (As na ), (As tot), and these bounds are in 
fact independent of whether or not feedback is performed 
along the conjugate process in the actual protocol, but 
only requires measurements to be performed along the 
conjugate process. For the other bounds stated in sec- 
tion 2, the values would depend sensitively on whether 
and how the feedback is performed along the conjugate 
dynamics, namely, the extended integral fluctuation the- 
orems can be stated as 



exp 



for k — 1,2,3 representing As tot, As na and As a , respec- 
tively, and this would lead to the bounds 



(As*) > 



(38) 



= I 



(37) 



As a consequence, arbitrary number of bounds can be 
computed for this latter case, which is not only confus- 
ing, but undermines the motivation behind such calcula- 
tions. Thus, the efficacy parameter is a far more suitable 
experimentally measurable quantity that can character- 
ize not only the performance of the system, but can also 
act as a useful lower bound for the averaged observables. 

V. CONCLUSIONS 

In this paper, we have shown that out of the two known 
forms of the modified fluctuation theorems in presence 
of feedback, one of the forms is heavily dependent on 
the way feedback is applied along the conjugate process, 
and thereby leads to arbitrary number of lower bounds 
for work done on the system or for the relevant entropy 
changes (total entropy, nonadiabatic and adiabatic en- 
tropies) taking place. On the other hand, the second 
form, namely the fluctuation theorem expressed in terms 
of the efficacy parameter, provides a bound for work and 
entropy changes that carries a clear and consistent phys- 
ical meaning, irrespective of the manner of application 
of feedback along the conjugate process. This consis- 
tency is robust even when the conjugate process is not 
the time-reversed process. This study would hopefully 
help in simpler experimental verification of the extended 
fluctuation theorems. 
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